Framing recommendations by image capture device

ABSTRACT

An image capture device may provide framing recommendations for capture of visual content. Framing recommendation may include information on how one or more subjects are to be positioned with respect to the image capture device. Framing recommendation may guide a user in how the image capture device and/or the subject(s) are to be positioned. Framing recommendation may include suggestions on orientation of the image capture device with respect to the subject(s) to improve composition of the subject(s) within the visual content. The image capture device may provide these aforementioned framing recommendations visually, audibly, and/or through other means. For example, the image capture device may provide framing recommendations in form of visual overlays/directional graphs and/or audible instructions (e.g., directions on subject/image capture device positioning provided through a speaker of the image capture device). Framing recommendation may be static (not changing over time) or dynamic (changing over time).

FIELD

This disclosure relates to an image capture device that providesrecommendations for framing.

BACKGROUND

A user may capture images/videos using an image capture device. Subjectof the images/videos may not be properly framed during capture of theimages/videos. Correcting improperly framed images/videos duringpostproduction may be difficult or not possible.

SUMMARY

This disclosure relates to providing framing recommendations. An imagecapture device may include a housing. The housing may have multiplesides. The housing may carry one or more of an image sensor, an opticalelement, a display, and/or other components. The optical element may becarried on a first side of the housing. The optical element may guidelight within a field of view to the image sensor. The image sensor maygenerate a visual output signal conveying visual information definingvisual content based on light that becomes incident thereon. The displaymay be carried on the first side of the housing. The visual content maybe captured during a capture duration. A framing recommendation may bepresented on the display. The framing recommendation may includeinformation on how a subject is to be positioned with respect to theimage capture device for future capture of the visual content.

An electronic storage may store visual information defining visualcontent, information relating to visual content, information relating toframing recommendation, information relating to subject, and/or otherinformation.

The housing may have multiple sides. The housing carry one or morecomponents of the image capture device. The housing may carry (beattached to, support, hold, and/or otherwise carry) one or more of animage sensor, an optical element, a display, a processor, an electronicstorage, and/or other components. The optical element and the displaymay be carried on the same side of the housing. The optical element andthe display may be carried on a first side of the housing. In someimplementations, the housing may carry multiple displays. In someimplementations, the housing may carry multiple image sensors andmultiple optical elements.

The image sensor may be configured to generate a visual output signaland/or other output signals. The visual output signal may convey visualinformation based on light that becomes incident on the image sensorand/or other information. The visual information may define visualcontent.

The optical element may be configured to guide light within a field ofview to the image sensor. The field of view may be less than 180degrees. The field of view may be equal to 180 degrees. The field ofview may be greater than 180 degrees.

The processor(s) may be configured by machine-readable instructions.Executing the machine-readable instructions may cause the processor(s)to facilitate providing framing recommendations. The machine-readableinstructions may include one or more computer program components. Thecomputer program components may include one or more of a capturecomponent, a recommendation component, and/or other computer programcomponents.

The capture component may be configured to capture the visual contentduring one or more capture durations. The visual content may be capturedthrough the optical element.

The recommendation component may be configured to present a framingrecommendation on a display. The display may be carried on the same sideof the housing as the optical element. The framing recommendation mayinclude information on how a subject is to be positioned with respect tothe image capture device for future capture of the visual content.

In some implementations, the framing recommendation may include one ormore outlines of how the subject should be depicted within the visualcontent. In some implementations, the outline(s) of how the subjectshould be depicted within the visual content may be overlaid on top of apreview of the visual content captured during the capture duration. Insome implementations, the preview of the visual content may include asilhouette representation of the visual content.

In some implementations, the framing recommendation may include one ormore arrow indicators that points in a direction in which the subjectand/or the image capture device should be moved. In someimplementations, size or color of an arrow indicator may indicate anextent to which the subject or the image capture device should be moved.

In some implementations, the framing recommendation may include apreview of the visual content captured during the capture duration. Thepreview may include an enlarged portion in which the subject should belocated. An extent of the visual content within the enlarged portion maybe warped to increase size of depiction within the enlarged portion.

In some implementations, the framing recommendation may be presented onthe display responsive to a face or a person being within the visualcontent captured during the capture duration.

In some implementations, the image capture device may further compriseanother display carried on a second side of the housing. The framingrecommendation may not be presented on the other display duringpresentation of the framing recommendation on the display. In someimplementations, the other display may be deactivated during thepresentation of the framing recommendation on the display.

These and other objects, features, and characteristics of the systemand/or method disclosed herein, as well as the methods of operation andfunctions of the related elements of structure and the combination ofparts and economies of manufacture, will become more apparent uponconsideration of the following description and the appended claims withreference to the accompanying drawings, all of which form a part of thisspecification, wherein like reference numerals designate correspondingparts in the various figures. It is to be expressly understood, however,that the drawings are for the purpose of illustration and descriptiononly and are not intended as a definition of the limits of theinvention. As used in the specification and in the claims, the singularform of “a,” “an,” and “the” include plural referents unless the contextclearly dictates otherwise.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 illustrates an example system that provides framingrecommendations.

FIG. 2 illustrates an example method for providing framingrecommendations.

FIGS. 3A and 3B illustrate example image capture devices.

FIGS. 4A, 4B, 4C, 4D, and 4E illustrate example framing recommendations.

FIGS. 5A and 5B illustrate example framing recommendations.

DETAILED DESCRIPTION

FIG. 1 illustrates a system 10 for providing framing recommendations.The system 10 may include one or more of a processor 11, an interface 12(e.g., bus, wireless interface), an electronic storage 13, an opticalelement 14, an image sensor 15, a display 16, and/or other components.The system 10 may include and/or be part of an image capture device. Theimage capture device may include a housing having multiple sides, andone or more of the optical element 14, the image sensor 15, the display16, and/or other components of the system 10 may be carried by thehousing of the image capture device. The optical element 14 and thedisplay 16 may be carried on the same side of the housing. The opticalelement 14 may guide light within a field of view to the image sensor15. The image sensor 15 may generate a visual output signal conveyingvisual information based on light that becomes incident thereon. Thevisual information may define visual content.

The visual content may be captured by the processor 11 during a captureduration. A framing recommendation may be presented on the display 16.The framing recommendation may include information on how a subject isto be positioned with respect to the image capture device for futurecapture of the visual content.

The electronic storage 13 may be configured to include electronicstorage medium that electronically stores information. The electronicstorage 13 may store software algorithms, information determined by theprocessor 11, information received remotely, and/or other informationthat enables the system 10 to function properly. For example, theelectronic storage 13 may store visual information defining visualcontent, information relating to visual content, information relating toframing recommendation, information relating to subject, and/or otherinformation.

Visual content may refer to content of image(s), video frame(s), and/orvideo(s) that may be consumed visually. For example, visual content maybe included within one or more images and/or one or more video frames ofa video. The video frame(s) may define/contain the visual content of thevideo. That is, video may include video frame(s) that define/contain thevisual content of the video. Video frame(s) may define/contain visualcontent viewable as a function of progress through the progress lengthof the video content. A video frame may include an image of the videocontent at a moment within the progress length of the video. As usedherein, term video frame may be used to refer to one or more of an imageframe, frame of pixels, encoded frame (e.g., I-frame, P-frame, B-frame),and/or other types of video frame. Visual content may be generated basedon light received within a field of view of a single image sensor orwithin fields of view of multiple image sensors.

Visual content (of image(s), of video frame(s), of video(s)) with afield of view may be captured by an image capture device during acapture duration. A field of view of visual content may define a fieldof view of a scene captured within the visual content. A captureduration may be measured/defined in terms of time durations and/or framenumbers. For example, visual content may be captured during a captureduration of 60 seconds, and/or from one point in time to another pointin time. As another example, 1800 images may be captured during acapture duration. If the images are captured at 30 images/second, thenthe capture duration may correspond to 60 seconds. Other capturedurations are contemplated.

Visual content may be stored in one or more formats and/or one or morecontainers. A format may refer to one or more ways in which theinformation defining visual content is arranged/laid out (e.g., fileformat). A container may refer to one or more ways in which informationdefining visual content is arranged/laid out in association with otherinformation (e.g., wrapper format). Information defining visual content(visual information) may be stored within a single file or multiplefiles. For example, visual information defining an image or video framesof a video may be stored within a single file (e.g., image file, videofile), multiple files (e.g., multiple image files, multiple videofiles), a combination of different files, and/or other files.

The system 10 may be remote from the image capture device or local tothe image capture device. One or more portions of the image capturedevice may be remote from or a part of the system 10. One or moreportions of the system 10 may be remote from or a part of the imagecapture device. For example, one or more components of the system 10 maybe carried by a housing, such as a housing of an image capture device.For instance, the optical element 14, the image sensor 15, and/or thedisplay 16 of the system 10 may be carried by the housing of the imagecapture device.

An image capture device may refer to a device captures visual content.An image capture device may capture visual content in form of images,videos, and/or other forms. An image capture device may refer to adevice for recording visual information in the form of images, videos,and/or other media. An image capture device may be a standalone device(e.g., camera, action camera, image sensor) or may be part of anotherdevice (e.g., part of a smartphone, tablet).

FIG. 3A illustrates an example image capture device 302. Visual content(e.g., of image(s), video frame(s)) may be captured by the image capturedevice 302. The image capture device 302 may include a housing 312. Thehousing 312 may refer a device (e.g., casing, shell) that covers,protects, and/or supports one or more components of the image capturedevice 302. The housing 312 may include a single-piece housing or amulti-piece housing. The housing 312 may have multiple sides. Thehousing 312 carry one or more components of the image capture device302. The housing 312 may carry (be attached to, support, hold, and/orotherwise carry) one or more of an optical element 304, an image sensor306, a display 308A, a display 308B, a processor 310, and/or othercomponents.

The optical element 304 and the display 308A may be carried on the sameside of the housing. For example, the optical element 304 and thedisplay 308A may be carried on a front side of the housing 312. Thedisplay 308A may be a front-facing display of the image capture device302. In some implementations, the housing 312 may carry multipledisplays, such as shown in FIG. 3A. The display 308B may be carried on arear side of the housing 312. The display 308B may be a rear-facingdisplay of the image capture device 302.

In some implementations, the housing may carry multiple image sensorsand multiple optical elements. FIG. 3B illustrates an example imagecapture device 352. Visual content (e.g., of spherical image(s),spherical video frame(s)) may be captured by the image capture device352. The image capture device 352 may include a housing 362. The housing362 carry one or more components of the image capture device 352. Thehousing 362 may carry one or more of an optical element A 354A, anoptical element B 354B, an image sensor A 356A, an image sensor B 356B,a display 368, a processor 360, and/or other components.

One or more components of the image capture device may be the same as,be similar to, and/or correspond to one or more components of the system10. For example, referring to FIG. 3A, the processor 310 may be the sameas, be similar to, and/or correspond to the processor 11. The opticalelement 304 may be the same as, be similar to, and/or correspond to theoptical element 14. The image sensor 306 may be the same as, be similarto, and/or correspond to the image sensor 15. The display 308A may bethe same as, be similar to, and/or correspond to the display 16. Thehousing may carry other components, such as the electronic storage 13.The image capture device may include other components not shown in FIGS.3A and 3B. The image capture device may not include one or morecomponents shown in FIGS. 3A and 3B. Other configurations of imagecapture devices are contemplated.

An optical element may include instrument(s), tool(s), and/or mediumthat acts upon light passing through the instrument(s)/tool(s)/medium.For example, an optical element may include one or more of lens, mirror,prism, and/or other optical elements. An optical element may affectdirection, deviation, and/or path of the light passing through theoptical element. An optical element may have a field of view (e.g.,field of view 305 shown in FIG. 3A). The optical element may beconfigured to guide light within the field of view (e.g., the field ofview 305) to an image sensor (e.g., the image sensor 306).

The field of view may include the field of view of a scene that iswithin the field of view of the optical element and/or the field of viewof the scene that is delivered to the image sensor. For example,referring to FIG. 3A, the optical element 304 may guide light within itsfield of view to the image sensor 306 or may guide light within aportion of its field of view to the image sensor 306. The field of viewof 305 of the optical element 304 may refer to the extent of theobservable world that is seen through the optical element 304. The fieldof view 305 of the optical element 304 may include one or more angles(e.g., vertical angle, horizontal angle, diagonal angle) at which lightis received and passed on by the optical element 304 to the image sensor306. In some implementations, the field of view 305 may be greater than180-degrees. In some implementations, the field of view 305 may be lessthan 180-degrees. In some implementations, the field of view 305 may beequal to 180-degrees.

In some implementations, the image capture device may include multipleoptical elements. The image capture device may include multiple opticalelements that are arranged on the housing to capture sphericalimages/videos (guide light within spherical field of view to one or moreimages sensors). For instance, referring to FIG. 3B, the image capturedevice 352 may include two optical elements 354A, 354B positioned onopposing sides of the housing 362. The fields of views of the opticalelements 354A, 354B may overlap and enable capture of spherical imagesand/or spherical videos.

An image sensor may include sensor(s) that converts received light intooutput signals. The output signals may include electrical signals. Theimage sensor may generate output signals conveying visual informationthat defines visual content of one or more images and/or one or morevideo frames of a video. For example, the image sensor may include oneor more of a charge-coupled device sensor, an active pixel sensor, acomplementary metal-oxide semiconductor sensor, an N-typemetal-oxide-semiconductor sensor, and/or other image sensors.

The image sensor may be configured generate output signals conveyinginformation that defines visual content of one or more images and/or oneor more video frames of a video. The image sensor may be configured togenerate a visual output signal based on light that becomes incidentthereon during a capture duration and/or other information. The visualoutput signal may convey visual information that defines visual contenthaving the field of view. For example, referring to FIG. 3A, the opticalelement 304 may be configured to guide light within the field of view305 to the image sensor 306, and the image sensor 306 may be configuredto generate visual output signals conveying visual information based onlight that becomes incident thereon via the optical element 304.

The visual information may define visual content by includinginformation that defines one or more content, qualities, attributes,features, and/or other aspects of the visual content. For example, thevisual information may define visual content of an image by includinginformation that makes up the content of the image, and/or informationthat is used to determine the content of the image. For instance, thevisual information may include information that makes up and/or is usedto determine the arrangement of pixels, characteristics of pixels,values of pixels, and/or other aspects of pixels that define visualcontent of the image. For example, the visual information may includeinformation that makes up and/or is used to determine pixels of theimage. Other types of visual information are contemplated.

Capture of visual content by the image sensor may include conversion oflight received by the image sensor into output signals/visualinformation defining visual content. Capturing visual content mayinclude recording, storing, and/or otherwise capturing the visualcontent for use in previewing and/or generating video content (e.g.,content of video frames). For example, during a capture duration, thevisual output signal generated by the image sensor 306 and/or the visualinformation conveyed by the visual output signal may be used to record,store, and/or otherwise capture the visual content for use in previewingand/or generating video content.

In some implementations, the image capture device may include multipleimage sensors. For example, the image capture device may includemultiple image sensors carried by the housing to capture sphericalimages/videos based on light guided thereto by multiple opticalelements. For instance, referring to FIG. 3B, the image capture device362 may include two image sensors 356A, 356B configured to receive lightfrom two optical elements 354A, 354B positioned on opposing sides of thehousing 362.

A display may refer to an electronic device that provides visualpresentation of information. A display may include a color displayand/or a non-color display. In some implementations, a display mayinclude one or more touchscreen displays. A display may be configured tovisually present information. A display may be configured to presentvisual content, user interface, and/or other information. User interface(graphical user interface) may include a graphical form that enables auser to interact with the image capture device and/or see informationprovided by the image capture device. For example, referring to FIG. 3A,the display 308A and/or the display 308B may present framingrecommendations, preview of visual content being captured by the imagecapture device 302 (e.g., preview of visual content before and/or duringrecording), visual content that has been captured by the image capturedevice 302, setting information of the image capture device 302 (e.g.,resolution, framerate, mode), and/or other information for the imagecapture device 302.

The display 308A (front-facing display) may enable a user to see framingrecommendations, visual content being captured by the image capturedevice 302, the user interface, the user interface elements, and/orother information while the image capture device 302 is pointed towardsthe user, such as when the user is in front of the image capture device302. The display 308B (rear-facing display) may enable a user to seeframing recommendations, visual content being captured by the imagecapture device 302, the user interface, the user interface elements,and/or other information while the image capture device 302 is pointedaway from the user, such as when the user is behind the image capturedevice 302. The display 308A may be smaller than the display 308B. Insome implementations, the display 308A may have an aspect ratio of 1:1.In some implementations, the display 308A may have a different aspectratio than the display 308B. For example, the display 308A may be asquare display while the display 308B may be a wide/non-square display.

A processor may include one or more processors (logic circuitry) thatprovide information processing capabilities in the image capture device.The processor may provide one or more computing functions for the imagecapture device. The processor may operate/send command signals to one ormore components of the image capture device to operate the image capturedevice. For example, referring to FIG. 3A, the processor 310 mayfacilitate operation of the image capture device 302 in capturingimage(s) and/or video(s), facilitate operation of the optical element304 (e.g., change how light is guided by the optical element 304),and/or facilitate operation of the image sensor 306 (e.g., change howthe received light is converted into information that definesimages/videos and/or how the images/videos are post-processed aftercapture).

The processor 310 may obtain information from the image sensor 306and/or facilitate transfer of information from the image sensor 306 toanother device/component. The processor 310 may be remote from theprocessor 11 or local to the processor 11. One or more portions of theprocessor 310 may be remote from the processor 11 and/or one or moreportions of the processor 10 may be part of the processor 310. Theprocessor 310 may include and/or perform one or more functionalities ofthe processor 11 shown in FIG. 1.

The image capture device 302 may provide framing recommendations forcapture of visual content by the image capture device 302. A framingrecommendation may include information on how one or more subjects areto be positioned with respect to the image capture device 302 for futurecapture of the visual content. The framing recommendation may guide auser in how the image capture device 302 and/or the subject(s) are to bepositioned for future capture of the visual content by the image capturedevice 302. Framing recommendation may include suggestions onorientation of the image capture device 302 with respect to thesubject(s) to improve composition of the subject(s) within the visualcontent. The image capture device 302 may provide framingrecommendations visually, audibly, and/or through other means. Forexample, the image capture device 302 may provide framing recommendationin the form of visual overlays/directional graphs (presented on thedisplay 308A, 308B), and/or audible instructions (e.g., directions onsubject/image capture device 302 positioning provided through speaker ofthe image capture device 302).

Referring back to FIG. 1, the processor 11 (or one or more components ofthe processor 11) may be configured to obtain information to facilitateautomatic control of display operation. Obtaining information mayinclude one or more of accessing, acquiring, analyzing, determining,examining, identifying, loading, locating, opening, receiving,retrieving, reviewing, selecting, storing, and/or otherwise obtainingthe information. The processor 11 may obtain information from one ormore locations. For example, the processor 11 may obtain informationfrom a storage location, such as the electronic storage 13, electronicstorage of information and/or signals generated by one or more sensors,electronic storage of a device accessible via a network, and/or otherlocations. The processor 11 may obtain information from one or morehardware components (e.g., an image sensor, an inertial measurementunit, a gyroscope, a accelerometer; one or more components shown inFIGS. 1, 3A, and 3B) and/or one or more software components (e.g.,software running on a computing device).

The processor 11 may be configured to provide information processingcapabilities in the system 10. As such, the processor 11 may compriseone or more of a digital processor, an analog processor, a digitalcircuit designed to process information, a central processing unit, agraphics processing unit, a microcontroller, an analog circuit designedto process information, a state machine, convolutional neural networks,generative adversarial networks, and/or other mechanisms forelectronically processing information. The processor 11 may beconfigured to execute one or more machine-readable instructions 100 tofacilitate providing framing recommendations. The machine-readableinstructions 100 may include one or more computer program components.The machine-readable instructions 100 may include one or more of acapture component 102, a recommendation component 104, and/or othercomputer program components.

The capture component 102 may be configured to capture the visualcontent during one or more capture durations. A capture duration mayrefer to a time duration in which visual content is captured. The visualcontent may be captured through one or more optical elements (e.g., theoptical element 14). For example, referring to FIG. 3A, the visualcontent may be captured through the optical element 304. Referring toFIG. 3B, the visual content may be captured through the optical elementA 354A and/or the optical element B 354B. The visual content may havethe field of view of the optical element(s).

Capturing visual content during a capture duration may include using,recording, storing, and/or otherwise capturing the visual content duringthe capture duration. For instance, visual content may be captured whilethe image capture device is operating in a record mode (e.g., videorecording mode) and/or operating in a preview mode (e.g., showingpreview of visual content to be captured on a display). The visualcontent may be captured for use in generating images and/or videoframes. The images/video frames may be stored in electronic storageand/or deleted after use (e.g., after preview).

For example, during a capture duration, the capture component 102 mayuse the visual output signal generated by the image sensor 15 and/or thevisual information conveyed by the visual output signal to record,store, and/or otherwise capture the visual content. For instance, thecapture component 102 may store, in the electronic storage 13 and/orother (permanent and/or temporary) electronic storage medium,information (e.g., the visual information) defining the visual contentbased on the visual output signal generated by the image sensor 15and/or the visual information conveyed by the visual output signalduring the capture duration. In some implementations, informationdefining the captured visual content may be stored in one or more visualtracks. In some implementations, the information defining the visualcontent may be discarded. For instance, the visual information definingthe visual content may be temporarily stored (e.g., in a buffer) toprovide framing recommendation, and the visual information may bedeleted after the determination and/or presentation of the framingrecommendation.

The recommendation component 104 may be configured to provide one ormore framing recommendations. A framing recommendation may be providedvia presentation on one or more displays (e.g., the display 16) and/orthrough one or more speakers. Provision of a framing recommendation mayinclude visual provision of the framing recommendation (e.g., usinggraphics on a display to show/achieve proper framing, showing textualinstructions on how to achieve proper framing on a display) and/oraudible provision of the framing recommendation (e.g., voiceinstructions on how to achieve proper framing, voice confirmation ofproper framing). In some implementations, a framing recommendation mayinclude information on the extent to which framing of things within thevisual content matches/satisfies the framing recommendation. Forexample, a framing recommendation may include a confidence indicatorthat states whether or not proper framing has been achieved and/or towhat extent (e.g., percentage-wise) proper framing has been achieved.

A framing recommendation may refer to a suggestion, proposal, and/orguidance on how to frame/position/place one or more subjects withinvisual content (e.g., of image(s), video frame(s)) for capture. Aframing recommendation may be static (not changing over time) or dynamic(changing over time). A framing recommendation may include informationon how one or more subjects are to be positioned with respect to theimage capture device for future capture of the visual content. A framingrecommendation may include information on recommended/suggestedplacement of subject(s) within the field of view of the visual content.A subject may refer to a living thing and/or a non-living thing to becaptured/depicted within the visual content. For example, a subject mayinclude a person, an animal, an object, a vehicle, a structure, anenvironment, and/or other living and/or non-living thing.

In some implementations, a framing recommendation may include a previewof the visual content captured during the capture duration. The framingrecommendation may use the preview of the visual content to providesuggestion, proposal, and/or guidance on how to frame/position/place oneor more subjects within the visual content. For instance, the framingrecommendation may include graphics overlaid on top of the preview ofthe visual content, with the graphics indicating proper framing ofsubject(s) and/or how to achieve proper framing of subject(s).

A framing recommendation may be determined and/or selected for provisionbased on user input, context of visual content capture, and/or otherinformation. For example, user input may specify a particular type/styleof framing desired by the user in capturing visual content. User inputmay be received at the image capture device and/or through a computingdevice communicatively coupled to the image capture device (e.g., mobiledevice paired with the image capture device). In some implementations, auser may be presented with options to select different types/styles offraming, and the user input may be received through user selection ofthe options. In some implementations, a user may be presented to turn onor turn off the provision of framing recommendation. For example, asetting of the image capture device may be changeable by the user toturn on or turn off the provision of framing recommendation by the imagecapture device.

Context of visual content capture may refer to circumstances and/orconditions of the subject, setting, and/or scene that is captured/to becaptured within the visual content. Context of the visual contentcapture may include circumstances and/or conditions of the image capturedevice during capture of the visual content. Context of the visualcontent capture may include circumstances and/or conditions of one ormore scenes (e.g., things within field of view of the image capturedevice) that are captured/to be captured within the visual content. Forexample, a framing recommendation may be determined and/or selected forprovision based on analysis of visual content and/or audio contentcaptured by the image capture device, based on analysis of metadata ofthe image capture device (e.g., time, date, location, motion), and/orother information.

For example, a framing recommendation may be determined and/or selectedfor provision based analysis of visual content captured by the capturecomponent 102. Analysis of the visual content may include examination,evaluation, processing, studying, and/or other analysis of the visualcontent. For example, analysis of the visual content may includeexamination, evaluation, processing, studying, and/or other analysis ofone or more visual features/characteristics of the visual content.Analysis of the visual content may include segmentation of the visualcontent, saliency/blob detection within the visual content, recognitionof things captured within the visual content (e.g., recognition ofobject, person, face, emotion, scene, action). Analysis of the visualcontent may include determination of whether and/or to what extent thevisual content satisfies one or more aesthetic rules, such as rule ofthirds, balanced composition, and/or center weighted composition.Analysis of the visual content may include determination of whetherand/or to what extent depiction of things within the visual contentneeds to be moved to satisfy one or more aesthetic rules. Otherdetermination/selection of framing recommendation is contemplated.

Analysis of the visual content may include analysis of visual content ofa single image/video frame and/or analysis of visual content of multipleimages/video frames. In some implementations, analysis of the visualcontent may include use of statistics and/or vectors to determinetrajectory of moving things within the visual content. The trajectorymay be used to provide framing recommendation on how to keep up with themoving things while capturing the visual content.

In some implementations, a display on which the framing recommendationis presented may be carried on the same side of the housing as theoptical element through which the visual content is captured. Forexample, referring to FIG. 3A, the image capture device 302 may capturethe visual content through the optical element 304, and the framingrecommendation may be presented on the display 308A (e.g., front-facingdisplay). Presentation of the framing recommendation on a front-facingdisplay may enable a user to determine/change framing while capturingvisual content. For example, a user may be able to determine whether asubject (e.g., target, user's face/body) is properly positioned withinthe visual content. If the position/depiction of the subject within thevisual content does not match the framing recommendation, then the usermay change orientation/positioning of the image capture device to thesubject until the subject is properly positioned/depicted within thevisual content.

FIGS. 4A, 4B, 4C, 4D, and 4E illustrate example framing recommendationspresented on a display 400. The display 400 may be a square display. Insome implementations, the display 400 may be a front-facing display ofan image capture device. Other shapes, sizes, and types of display arecontemplated.

In some implementations, the framing recommendation may include one ormore outlines of how a subject should be depicted within the visualcontent. In some implementations, the outline(s) of how the subjectshould be depicted within the visual content may be overlaid on top of apreview of the visual content captured during the capture duration. Forexample, referring to FIG. 4A, a framing recommendation 410 may bepresented on the display 410. The framing recommendation 410 may includean outline 412. The outline 412 may show how a person should be depictedwithin the visual content to achieve proper framing. The framingrecommendation 410 may include presentation of preview of visual contentcaptured by the image capture device. Presenting the outline 412 on topof the preview may enable a user to change the orientation of the imagecapture device to the subject (by moving the image capture device and/orthe subject) while seeing in real time how the subject is depictedwithin the visual content. For example, a user may change theorientation of the image capture device to the subject until the subjectmatches/fits within the outline 412.

In some implementations, the preview of the visual content may include asilhouette representation of the visual content. A silhouetterepresentation of the visual content may include a two-dimensionalrepresentation of the visual content. A silhouette presentation of thevisual content may include a two-dimensional representation of one ormore subjects. A silhouette presentation of the visual content mayinclude a two-dimensional representation of a subject as an outlinefilled with single color/shading).

For example, a silhouette representation of visual content including aperson may include an outline of the person uniformly filled with asingle color/shading. For example, referring to FIG. 4B, a framingrecommendation 420 may be presented on the display 410. The framingrecommendation 420 may include an outline 422. The outline 422 may showhow a person should be depicted within the visual content to achieveproper framing. The framing recommendation 420 may include a silhouetterepresentation 424. The silhouette representation 424 may include anoutline of a person captured within the visual content, with the outlineuniformly filled with a single color/shading. Presenting the outline 422and the silhouette representation 424 may enable a user to change theorientation of the image capture device to the subject (by moving theimage capture device and/or the subject) while seeing in real time howthe subject is depicted within the visual content. For example, a usermay change the orientation of the image capture device to the subjectuntil the silhouette representation matches/fits within the outline 422.

In some implementations, the framing recommendation may include one ormore arrow indicators. An arrow indicator may point in a direction inwhich the subject and/or the image capture device should be moved(translationally and/or rotationally). In some implementations, sizeand/or color of an arrow indicator may indicate an extent to which thesubject or the image capture device should be moved. For example, abigger arrow and/or a particular color may indicate that the subject orthe image capture device needs to be moved more than a smaller arrowand/or a different color.

For example, referring to FIG. 4C, a framing recommendation 430 may bepresented on the display 400. The framing recommendation 430 may includean arrow indicator 432. The arrow indicator 432 may point down and tothe left, indicating that the subject and/or the image capture deviceshould be moved down and to the left. The size and/or color of the arrowindicator 432 may indicator how far the subject and/or the image capturedevice needs to be moved down and to the left to achieve proper framing.

Referring to FIG. 4D, a framing recommendation 440 may be presented onthe display 400. The framing recommendation 440 may include an arrowindicator 442. The arrow indicator 442 may point upwards with acurvature, indicating that the subject and/or the image capture deviceshould be tilted up. The size and/or color of the arrow indicator 442may indicator how far the subject and/or the image capture device needsto be tilted up to achieve proper framing.

In some implementations, the framing recommendation may include apreview of the visual content captured during the capture duration. Thepreview may include an enlarged portion in which the subject should belocated. An extent of the visual content within the enlarged portion maybe warped to increase size of depiction within the enlarged portion. Theincrease in size of depiction within the enlarged portion may be greaterthan in other portions of the preview. In some implementations,different image projection may be used for the enlarged portion versusother portion of the preview. For example, a non-linear projection (inwhich straight lines appear as curved lines) may be used for theenlarged portion while a linear projection (in which straight linesappear as straight lines) may be used for other portions of the preview.

For example, referring to FIG. 4E, a framing recommendation 450 may bepresented on the display 400. The framing recommendation 450 may includea preview of the visual content. The framing recommendation 450 mayinclude an enlarged portion 452 in which the extent of the visualcontent is warped to increase size of depiction. A user may determinewhether and/or to what extent the subject has been properly framedwithin the visual content by checking whether and/or to what extent thesubject appears within the enlarged portion 452 (e.g., the subjectappears magnified in the framing recommendation). For example, a usermay determine whether and/or to what extent a face has been properlyframed within the visual content by whether and/or to what extent theface appears within the enlarged portion 452. Use of the enlargedportion 452 may enable a user to get a closer/larger view of the subjectwhile framing. For example, use of the enlarged portion 452 may enable auser to get a closer/larger view of the face while framing.

In some implementations, the preview of the visual content on a displaymay be cropped and/or distorted. For example, the aspect ratio of thedisplay may not match the aspect ratio of the display. The visualcontent may be presented on the display by cropping out portion(s) ofthe visual content (e.g., display center portion of the visual contentwhile cropping out lateral portions). The visual content may bepresented on the display by laterally squeezing the visual content. Suchpresentation of the preview may make it difficult for a user todetermine whether proper framing has been achieved.

The framing recommendation may take into account cropping and/ordistortion of the preview. The visual elements of the framingrecommendation may be adjusted based on the cropping and/or distortionof the preview so that subject(s) are properly framed within the visualcontent. FIGS. 5A and 5B illustrate example framing recommendationspresented on a display 500. The display 500 may be a square display. Insome implementations, the display 500 may be a front-facing display ofan image capture device. Other shapes, sizes, and types of display arecontemplated.

Referring to FIG. 5A, a framing recommendation 510 may be presented onthe display 500. The framing recommendation 510 may include a preview ofthe visual content. A field of view 514 of the visual content may belarger than the display, and the preview may include the visual contentcropped so that only the center portion of the visual content isincluded within the preview, and left and right portions of the visualcontent not included within the preview. The framing recommendation 510may include an outline 512. The outline 512 may show how a person shouldbe depicted within the visual content to achieve proper framing. Theframing recommendation 510 may take into account cropping of the visualcontent within the preview. The outline 512 may be positioned within theframing recommendation based on the field of view 514 of the visualcontent. While positioning the subject within the outline 512 may makeframing of the subject to be off (e.g., placed too far to the right),such positioning of the subject may achieve proper framing within theuncropped visual content.

Referring to FIG. 5B, a framing recommendation 520 may be presented onthe display 500. The framing recommendation 520 may include a preview ofthe visual content. A field of view of the visual content may be largerthan the display, and the preview may include the visual contentlaterally squeezed to fit the entire visual content onto the display500. The framing recommendation 520 may include an outline 522. Theoutline 522 may show how a person should be depicted within the visualcontent to achieve proper framing. The framing recommendation 520 maytake into account squeezing of the visual content within the preview.The outline 522 may be distorted (squeezed) to match the distortion ofthe visual content within the preview. Distortion of the visual contentwithin the preview may make it difficult for a user to determine actuallocation of the subject within the visual content. Positioning thesubject within the outside 522 may achieve proper framing within theundistorted visual content.

In some implementations, the framing recommendation may be provided(e.g., presented on the display(s), provide through speaker(s)) based onuser selection. User selection may specify whether or not the framingrecommendation is to be provided, mean(s) through which the framingrecommendation is to be provided, the frequency with which the framingrecommendation is to be provided, and/or other settings relating to theprovision of framing recommendation. For example, an image capturedevice may include options for users to enable/disable provision offraming recommendation and/or when/how often the framing recommendationis provided.

In some implementations, the framing recommendation may be presented onthe display 16 responsive to a face or a person being within the visualcontent captured during the capture duration. Presenting the framingrecommendation responsive to a face and/or a person being within thevisual content may include using the display 16 to provide a view of theframing recommendation. In some implementations, presenting the framingrecommendation responsive to a face and/or a person being within thevisual content may include turning on the display 16 and/or changingtype of information presented on the display 16. For example, thedisplay 16 may be turned off, and the recommendation component 104 mayturn on the display 16 to present the framing recommendation. As anotherexample, the display 16 may be turned on and presenting non-previewinformation (e.g., setting of the image capture device), and therecommendation component 104 may change display operation to present theframing recommendation.

In some implementations, the framing recommendation may not be presentedon the display 16 responsive to a face and/or a person not being withinthe visual content captured during the capture duration. Not presentingthe framing recommendation responsive to a face and/or a person notbeing within the visual content may include not using the display 16 toprovide a view of the framing recommendation. In some implementations,not presenting the framing recommendation responsive to a face and/or aperson not being within the visual content may include turning off thedisplay 16 and/or changing type of information presented on the display16. For example, the display may be turned on and presenting framingrecommendation, and the recommendation component 104 may turn off thedisplay 16 to deactivate presentation of the framing recommendation onthe display 16. As another example, the display 16 may be turned on andpresenting framing recommendation, and the recommendation component 104may change display operation to present setting of the image capturedevice and/or other information on the display 16.

In some implementation, the framing recommendation may be automaticallyturned on based on face/person detection indicating that a person isviewing the display 16 and/or the person is in a position to view thedisplay 16. The framing recommendation may be automatically turned offbased on face/person detection indicating that a person is not viewingthe display 16 and/or the person is not in a position to view thedisplay 16. Whether or not a face and/or a person is within the visualcontent may be determined based on analysis of the visual content and/orother information. The visual content captured by the capture component102 may be analyzed to determine whether a face and/or a person islocated within the visual content.

In some implementations, the image capture device may further compriseanother display. The other display may be carried on a different side ofthe housing than the display 16. For example, the image capture devicemay include a front-facing display (on which the framing recommendationis presented) and a rear-facing display. The framing recommendation maynot be presented on the other display (e.g., rear-facing display) duringpresentation of the framing recommendation on the display 16 (e.g.,front-facing display). In some implementations, the other display (e.g.,rear-facing display) may be deactivated (e.g., turned off, put intosleep mode) during the presentation of the framing recommendation on thedisplay 16 (e.g., front-facing display). In some implementations, theframing recommendation may be presented on the other display (e.g.,front-facing display). The framing recommendation may not be presentedon the display 16 (e.g., rear-facing display). The display 16 (e.g.,front-facing display) may be deactivated (e.g., turned off, put intosleep mode) during the presentation of the framing recommendation on theother display (e.g., rear-facing display).

Implementations of the disclosure may be made in hardware, firmware,software, or any suitable combination thereof. Aspects of the disclosuremay be implemented as instructions stored on a machine-readable medium,which may be read and executed by one or more processors. Amachine-readable medium may include any mechanism for storing ortransmitting information in a form readable by a machine (e.g., acomputing device). For example, a tangible (non-transitory)machine-readable storage medium may include read-only memory, randomaccess memory, magnetic disk storage media, optical storage media, flashmemory devices, and others, and a machine-readable transmission mediamay include forms of propagated signals, such as carrier waves, infraredsignals, digital signals, and others. Firmware, software, routines, orinstructions may be described herein in terms of specific exemplaryaspects and implementations of the disclosure, and performing certainactions.

In some implementations, some or all of the functionalities attributedherein to the system 10 may be provided by external resources notincluded in the system 10. External resources may include hosts/sourcesof information, computing, and/or processing and/or other providers ofinformation, computing, and/or processing outside of the system 10.

Although the processor 11 and the electronic storage 13 are shown to beconnected to the interface 12 in FIG. 1, any communication medium may beused to facilitate interaction between any components of the system 10.One or more components of the system 10 may communicate with each otherthrough hard-wired communication, wireless communication, or both. Forexample, one or more components of the system 10 may communicate witheach other through a network. For example, the processor 11 maywirelessly communicate with the electronic storage 13. By way ofnon-limiting example, wireless communication may include one or more ofradio communication, Bluetooth communication, Wi-Fi communication,cellular communication, infrared communication, or other wirelesscommunication. Other types of communications are contemplated by thepresent disclosure.

Although the processor 11 is shown in FIG. 1 as a single entity, this isfor illustrative purposes only. In some implementations, the processor11 may comprise a plurality of processing units. These processing unitsmay be physically located within the same device, or the processor 11may represent processing functionality of a plurality of devicesoperating in coordination. The processor 11 may be configured to executeone or more components by software; hardware; firmware; some combinationof software, hardware, and/or firmware; and/or other mechanisms forconfiguring processing capabilities on the processor 11.

It should be appreciated that although computer components areillustrated in FIG. 1 as being co-located within a single processingunit, in implementations in which processor 11 comprises multipleprocessing units, one or more of computer program components may belocated remotely from the other computer program components.

While computer program components are described herein as beingimplemented via processor 11 through machine-readable instructions 100,this is merely for ease of reference and is not meant to be limiting. Insome implementations, one or more functions of computer programcomponents described herein may be implemented via hardware (e.g.,dedicated chip, field-programmable gate array) rather than software. Oneor more functions of computer program components described herein may besoftware-implemented, hardware-implemented, or software andhardware-implemented

The description of the functionality provided by the different computerprogram components described herein is for illustrative purposes, and isnot intended to be limiting, as any of computer program components mayprovide more or less functionality than is described. For example, oneor more of computer program components may be eliminated, and some orall of its functionality may be provided by other computer programcomponents. As another example, processor 11 may be configured toexecute one or more additional computer program components that mayperform some or all of the functionality attributed to one or more ofcomputer program components described herein.

The electronic storage media of the electronic storage 13 may beprovided integrally (i.e., substantially non-removable) with one or morecomponents of the system 10 and/or as removable storage that isconnectable to one or more components of the system 10 via, for example,a port (e.g., a USB port, a Firewire port, etc.) or a drive (e.g., adisk drive, etc.). The electronic storage 13 may include one or more ofoptically readable storage media (e.g., optical disks, etc.),magnetically readable storage media (e.g., magnetic tape, magnetic harddrive, floppy drive, etc.), electrical charge-based storage media (e.g.,EPROM, EEPROM, RAM, etc.), solid-state storage media (e.g., flash drive,etc.), and/or other electronically readable storage media. Theelectronic storage 13 may be a separate component within the system 10,or the electronic storage 13 may be provided integrally with one or moreother components of the system 10 (e.g., the processor 11). Although theelectronic storage 13 is shown in FIG. 1 as a single entity, this is forillustrative purposes only. In some implementations, the electronicstorage 13 may comprise a plurality of storage units. These storageunits may be physically located within the same device, or theelectronic storage 13 may represent storage functionality of a pluralityof devices operating in coordination.

FIG. 2 illustrates method 200 for providing framing recommendations. Theoperations of method 200 presented below are intended to beillustrative. In some implementations, method 200 may be accomplishedwith one or more additional operations not described, and/or without oneor more of the operations discussed. In some implementations, two ormore of the operations may occur simultaneously.

In some implementations, method 200 may be implemented in one or moreprocessing devices (e.g., a digital processor, an analog processor, adigital circuit designed to process information, a central processingunit, a graphics processing unit, a microcontroller, an analog circuitdesigned to process information, a state machine, and/or othermechanisms for electronically processing information). The one or moreprocessing devices may include one or more devices executing some or allof the operation of method 200 in response to instructions storedelectronically on one or more electronic storage media. The one or moreprocessing devices may include one or more devices configured throughhardware, firmware, and/or software to be specifically designed forexecution of one or more of the operations of method 200.

Referring to FIG. 2 and method 200, an image capture device may includea housing. The housing may have multiple sides. The housing may carryone or more of an image sensor, an optical element, a display, and/orother components. The optical element may be carried on a first side ofthe housing. The optical element may guide light within a field of viewto the image sensor. The image sensor may generate a visual outputsignal conveying visual information defining visual content based onlight that becomes incident thereon. The display may be carried on thefirst side of the housing.

At operation 201, the visual content may be captured during a captureduration. In some implementation, operation 201 may be performed by aprocessor component the same as or similar to the capture component 102(Shown in FIG. 1 and described herein).

At operation 202, a framing recommendation may be presented on thedisplay. The framing recommendation may include information on how asubject is to be positioned with respect to the image capture device forfuture capture of the visual content. In some implementations, operation202 may be performed by a processor component the same as or similar tothe recommendation component 104 (Shown in FIG. 1 and described herein).

Although the system(s) and/or method(s) of this disclosure have beendescribed in detail for the purpose of illustration based on what iscurrently considered to be the most practical and preferredimplementations, it is to be understood that such detail is solely forthat purpose and that the disclosure is not limited to the disclosedimplementations, but, on the contrary, is intended to covermodifications and equivalent arrangements that are within the spirit andscope of the appended claims. For example, it is to be understood thatthe present disclosure contemplates that, to the extent possible, one ormore features of any implementation can be combined with one or morefeatures of any other implementation.

What is claimed is:
 1. An image capture device that providesrecommendations for framing, the image capture device comprising: ahousing having multiple sides; an image sensor carried by the housingand configured to generate a visual output signal conveying visualinformation based on light that becomes incident thereon, the visualinformation defining visual content; an optical element carried on afirst side of the housing, the optical element configured to guide lightwithin a field of view to the image sensor; a first display carried onthe first side of the housing, a display aspect ratio of the firstdisplay different from a visual aspect ratio of the visual contentcaptured through the optical element, wherein a preview of the visualcontent presented on the first display includes a cropped view of thevisual content to fit the preview of the visual content within the firstdisplay with the display aspect ratio different from the visual aspectratio of the visual content; one or more physical processors carried bythe housing, the one or more physical processors configured bymachine-readable instructions to: capture the visual content during acapture duration; and present a framing recommendation on the firstdisplay with the preview of the visual content including the croppedview of the visual content, the framing recommendation includinginformation on how a subject is to be positioned with respect to theimage capture device for future capture of the visual content, whereinthe framing recommendation takes into account the cropping of the visualcontent in the preview presented on the first display.
 2. The imagecapture device of claim 1, wherein the framing recommendation includesan outline of how the subject should be depicted within the visualcontent.
 3. The image capture device of claim 2, wherein the outline ofhow the subject should be depicted within the visual content is overlaidon top of a preview of the visual content captured during the captureduration.
 4. The image capture device of claim 3, wherein the preview ofthe visual content includes a silhouette representation of the visualcontent.
 5. The image capture device of claim 1, wherein the framingrecommendation includes an arrow indicator that points in a direction inwhich the subject or the image capture device should be moved.
 6. Theimage capture device of claim 5, wherein size or color of the arrowindicator indicates an extent to which the subject or the image capturedevice should be moved.
 7. The image capture device of claim 1, whereinthe preview of the visual content includes a first portion in which thevisual content is presented using a linear projection in which astraight line appears straight and a second portion in which the visualcontent is presented using a non-linear projection in which the straightline appears curved, wherein a location of the second portion indicateswhere the subject is to be placed, wherein placement of the subjectwithin the second portion causes the preview of the visual content toinclude an enlarged view of the subject.
 8. The image capture device ofclaim 1, further comprising a second display carried on a second side ofthe housing, wherein the framing recommendation is not presented on thesecond display during presentation of the framing recommendation on thefirst display.
 9. The image capture device of claim 8, wherein thesecond display is deactivated during the presentation of the framingrecommendation on the first display.
 10. The image capture device ofclaim 1, wherein the framing recommendation is determined based on atrajectory of a moving thing within the visual content, the framingrecommendation providing information on framing of the moving thing tokeep up with the moving thing during capture of the visual content. 11.A method for providing recommendations for framing, the method performedby an image capture device including one or more processors, a housinghaving multiple sides, an image sensor carried by the housing andconfigured to generate a visual output signal conveying visualinformation based on light that becomes incident thereon, the visualinformation defining visual content, an optical element carried on afirst side of the housing, the optical element configured to guide lightwithin a field of view to the image sensor, and a first display carriedon the first side of the housing, a display aspect ratio of the firstdisplay different from a visual aspect ratio of the visual contentcaptured through the optical element, wherein a preview of the visualcontent presented on the first display includes a cropped view of thevisual content to fit the preview of the visual content within the firstdisplay with the display aspect ratio different from the visual aspectratio of the visual content, the method comprising: capturing the visualcontent during a capture duration; and presenting a framingrecommendation on the first display with the preview of the visualcontent including the cropped view of the visual content, the framingrecommendation including information on how a subject is to bepositioned with respect to the image capture device for future captureof the visual content, wherein the framing recommendation takes intoaccount the cropping of the visual content in the preview presented onthe first display.
 12. The method of claim 11, wherein the framingrecommendation includes an outline of how the subject should be depictedwithin the visual content.
 13. The method of claim 12, wherein theoutline of how the subject should be depicted within the visual contentis overlaid on top of a preview of the visual content captured duringthe capture duration.
 14. The method of claim 13, wherein the preview ofthe visual content includes a silhouette representation of the visualcontent.
 15. The method of claim 11, wherein the framing recommendationincludes an arrow indicator that points in a direction in which thesubject or the image capture device should be moved.
 16. The method ofclaim 15, wherein size or color of the arrow indicator indicates anextent to which the subject or the image capture device should be moved.17. The method of claim 11, wherein the preview of the visual contentincludes a first portion in which the visual content is presented usinga linear projection in which a straight line appears straight and asecond portion in which the visual content is presented using anon-linear projection in which the straight line appears curved, whereina location of the second portion indicates where the subject is to beplaced, wherein placement of the subject within the second portioncauses the preview of the visual content to include an enlarged view ofthe subject.
 18. The method of claim 11, wherein the image capturedevice further includes a second display carried on a second side of thehousing, and the framing recommendation is not presented on the seconddisplay during presentation of the framing recommendation on the firstdisplay.
 19. The method of claim 18, wherein the second display isdeactivated during the presentation of the framing recommendation on thefirst display.
 20. The method of claim 11, wherein the framingrecommendation is determined based on a trajectory of a moving thingwithin the visual content, the framing recommendation providinginformation on framing of the moving thing to keep up with the movingthing during capture of the visual content.